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A HAND-HELD VIDEO VIEWER 
AND REMOTE CONTROL DEVICE 



RELATED ART 

5 This application is a continuation-in-part of U.S. Serial No. 09/078,604 filed May 13, 

1998. 



FIELD OF THE INVENTION 

The present invention relates to the field of control devices for user control of home 
10 appliances. Particularly, the present invention relates to a control device having access to 

network delivered information and for displaying video programming on a hand-held remote 
--vf device. 

0 BACKGROUND OF THE INVENTION 

115 It has become increasingly important to enable home consumers to obtain and use a 

wealth of information received from outside the home or business and to use such information 
for viewing or controlling home/business appliances or consumer electronics. In recent times, 
r y the Internet and the World Wide Web (WWW) have been important new sources of electronic 
% information. In addition, radio and television broadcasts available via cable or satellite 
20 communications are also additional sources of information available for the home or business 
consumer. Additionally, the conventional telephone network is yet another source of information 
and a valuable information communication medium. 

Although these various forms of video programming, information sources, and electronic 
communication media exist, the prior art systems have been unable to effectively combine these 
25 information sources and communication media into a readily usable and convenient control 
device. Because the information sources provide such a wealth of information in a highly 
divergent set of formats, it has been particularly difficult to combine this divergent information 
into a convenient and robust control device. Moreover, because each of the various information 
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sources may not be available at all locations, it is necessary to provide a control device that is 
uniformly useful no matter where it may be deployed. 

Various forms of prior art devices exist. For example, U.S Patent No. 5,710,605 entitled 
"Remote Control Unit for Controlling a Television and Video Cassette Recorder with a Display 
5 for Allowing a User to Select Between Various Programming Schedules" discloses a universal 
remote control unit for controlling a television and videocassette recorder. The device includes a 
data input mechanism securable to a telephone line for receiving signals from an external 
supplier representing television programming schedule items. The device includes a display 
mechanism for displaying television programming schedule items and television and 
10 videocassette operating functions in a hierarchy of textual and scrollable selection lists. The 
^J; device also includes a user-operable selector mechanism for allowing a user to scroll through the 
lists and then select television programming schedule items or television and videocassette 
J:^ functions. Although the device provides a wealth of functionality, the user interface is 
excessively complex and confusing. The user is presented with a myriad of buttons and menu 
45 displays, which easily confuse an unsophisticated user. Further, the display on the remote control 
i™ ; unit is not described as useable to display television programming and the device provides only a 
p j telephone line link for receiving external information via the telephone network, 
rji Further, other devices exist in the prior art for receiving information via the vertical 

blanking interval (VBI) in a cable television transmission. Using the VBI, data can be 
20 transmitted across a video cable at the same time as real-time video images are transmitted on the 
cable. Using this technique, data can be transmitted to a wide audience using the cable television 
infrastructure. Many conventional set-top boxes are coupled to such cable TV systems and 
receive data transmitted during the VBI. 

Other prior art systems describe various ways of displaying and manipulating electronic 
25 programming guide (EPG) information on a conventional television (TV) monitor. These on- 
screen television guides necessarily interrupt the standard video signal while the user is 
manipulating the EPG display on the monitor. Such interruptions affect all those who are viewing 
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the monitor. Further, no privacy can be provided for a user manipulating the EPG information if 
the information is displayed on the TV monitor. 

Thus, a better control device is needed for remotely viewing television signals and for 
receiving information from external sources and for using the information for controlling home 
appliances including television sets. 

SUMMARY OF THE INVENTION 

A control device and system for remotely viewing video programming and for monitoring 
and controlling electronic devices is disclosed. In one embodiment., a control device for 
monitoring and controlling an electronic device, includes: 1) a base unit having a microcontroller 
and a data interface coupled to the microcontroller for sending and/or receiving external 
information, the base unit further including a video interface for receiving video programming 
signals; and 2) a hand-held remote device in communication with the base unit via a data link, 
the hand-held remote device further including a display component for displaying at least a 
portion of the external information received from the data interface, the display component also 
for rendering video content in the video programming signals received from the video interface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a block diagram of the architecture of the base station of one 
embodiment. 

Figure 2 illustrates a block diagram of the architecture of the remote unit of one 
embodiment. 

Figure 3 A illustrates the remote unit and base station of one embodiment. 
Figures 3B and 3C illustrate other alternative embodiments of the remote unit. 
Figure 4 is a flowchart illustrating the processing logic used in one embodiment for 
handling key activations in the remote device. 
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Figure 5 is a flowchart illustrating the processing logic used in one embodiment for 
processing the receipt of external information at the base station. 

Figures 6-11 are more detailed flowcharts illustrating the processing logic used in one 
embodiment for processing the receipt of external information at the base station. 
5 Figures 12-53 illustrate various screen displays and menu configurations for invoking the 

various functionality enabled by the present invention. 

Figure 54 illustrates a block diagram of an alternative embodiment of the architecture of 
the base station of the present invention. 

Figure 55 illustrates the basic system configuration of the television monitor, base unit, 
10 and hand-held remote device. 

^ Figure 56 is a structure diagram illustrating the components of the base unit of one 

embodiment. 

]f t Figure 57 is a structure diagram illustrating the components of the hand-held remote 

^ device of one embodiment. 

;15 

H : DETAILED DESCRIPTION OF ONE EMBODIMENT 

A control device and system for remotely viewing television programming and for 

jj| monitoring and controlling electronic devices is disclosed. In the following description, for 
purposes of explanation, numerous specific details are set forth in order to provide a thorough 

20 understanding of the present invention. It will be evident, however, to one of ordinary skill in the 
art that the present invention may be practiced without these specific details. In other instances, 
well-known structures and devices are shown in block diagram form in order to avoid 
unnecessarily obscuring the present invention. 

The Personal Television Viewer and Navigator (referred to herein as the PTVN) is a 

25 hand-held remote device which forms a general, nearly unlimited standard user-interface for 
home appliance control, including television, video cassette recorder (VCR), and stereo control, 
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and applications including ("Home Browsing"). The PTVN is equipped with a display unit and 
selection means to choose among the possible functions and features of the PTVN. A diagram of 
various embodiments of the PTVN is illustrated in Figures 3A-3C. A block diagram of another 
embodiment of the PTVN is illustrated in Figure 57. Block diagrams of the base station 100 and 
the remote device 200 are shown in Figures 1 and 2, respectively. Figure 56 illustrates a block 
diagram of another embodiment of the base station of the present invention. 

Referring now to Figure 1, a block diagram illustrates the system architecture of the base 
station of one embodiment of the present invention. The base station 100 receives external 
information from a cable television provider 110 and/or external information received from the 
Internet 114 or other digital sources 115 via telephone network 112. In regard to the external 
information received from cable provider 110, a video signal with digital data inserted in the 
vertical blanking interval (VBI) is received by base station 100 and a tuner 120 therein. It will be 
apparent to those of ordinary skill in the art that there are alternative techniques other than the 
use of the VBI to transmit data with a video signal. For example, the overscan portion of a video 
signal or a separate carrier may be used for the transmission of data with a video signal. Tuner 
120 separates out the various channels received from cable provider 110. The raw video signals 
can be passed through to television 140 or videocassette recorder (VCR) 142 as a standard video 
input. VBI decoder 122, coupled to tuner 120, receives a data stream in the vertical blanking 
interval (VBI) of a particular predetermined channel. Using conventional techniques, the data 
encoded in VBI can be extracted and provided to a microcontroller 130. As mentioned above, 
VBI decoder 122 may alternatively be another conventional type of decoder for decoding data 
from the overscan portion or a separate carrier on the predetermined channel. Microcontroller 
130 decodes the information, descrambles it (if necessary) and looks for service and control 
information in the VBI information. For example, enabling or disabling signals of the PTVN 
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service will cause the base station controller 130 to send data to the remote device 200 or not 
(conditional access). Microcontroller 130 receives the VBI encoded data as one source of 
external information provided to base station 100. 

In addition or solely, base station 100 may include modem 136 for receiving digital 
information via the conventional telephone network 112. Using conventional technology, 
modem 136 can be coupled via telephone network 1 12 to the Internet 114 via an Internet service 
provider (not shown). Additionally, modem 136 can be coupled through telephone network 112 
to a point-to-point or proprietary data source 115 using conventional techniques. Information 
received from these external sources via telephone network 1 12 is passed through modem 136 to 
microcontroller 130 as an additional external information source. Alternatively, base station 100 
may also include an interface for coupling the base station 100 to a conventional computer 
network. External information from a conventional computer network may then be received by 
the base station 100 and microcontroller 130 therein. Microcontroller 130 may then store this 
external information in memory 131 for subsequent processing. Memory 131 may be a volatile 
type of memory such as a dynamic random access memory (DRAM) or a non- volatile form of 
memory such as flash memory or battery-backed CMOS memory. Microcontroller 130 and the 
other electronic components of base station 100 are powered by power supply 132, which 
receives external power through power adapter 144. Power supply 132 may also be used to 
supply an internal power source for charging circuits 134, which are used to charge the batteries 
of the remote device 200. 

Microcontroller 130 includes an interface to a remote interface device 138 with which 
base station 100 may communicate with the remote device 200 or personal television viewer and 
navigator (PTVN) of the present invention. Remote interface 138 may be a conventional infrared 
(IR) link with a corresponding interface transmitter/receiver 210 within remote device 200. If an 
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IR interface is used, the transmission of data can be one-way (i.e. from remote device 200 to base 
station 100) or two-way ( i.e. both the base station 100 and the remote device 200 have IR 
transmitters and IR receivers). In an alternative embodiment, remote interface 138 may be a 
direct coupling connection between base station 100 and remote device 200. Direct coupling can 
mean a simple point to point connection e.g., with digital logic or optical levels. This also 
includes the use of standard interfaces (parallel or serial), such as Centronics (PC parallel port), 
or serial communications via RS232 or RS422, use of standard networks like ethernet, or even 
such enhanced communication interfaces like SCSI, USB (universal serial bus) or even 
IEEE1394 Firewire. In fact, one could use any kind of standard interface available in a 
conventional set-top box, personal computer, or information appliance. In addition, these direct 
coupling interface configurations include all those interfaces using galvanic, i.e. direct electrical 
contacts or other means such as optical isolation or magnetic/capacitor means. In another 
alternative embodiment, the remote interface 138 may be a wireless radio frequency (RF) 
communication interface between the remote device 200 and the base station 100. Such RF 
communication methods are well known and used, for example, in cordless telephones. 

For identification of the present invention, a unique number resides inside the base station 
100 secure within EEPROM 133. The unique identification number is pre-loaded at manufacture 
time and enables the base station 100 and the PTVN 200 to be uniquely identified from all other 
similar devices. Alternatively, the identification number, secured in an EEPROM or similar 
conventional non-volatile memory device, may also be stored in the PTVN 200 itself. In this 
manner, the PTVN 200 can be uniquely identified. 

If the hand-held PTVN device 200 is coupled to the base station 100 via electrical 
contacts, the PTVN 200 is supplied with information (in addition to charging the batteries) only 
when PTVN 200 is coupled to the base 100. In this case, no buffer memory is needed inside the 
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base 100. The technically most simple form of supplying the PTVN hand-held device 200 with 
information is transmitting the data via galvanic connectors during charging of the batteries. If 
programming changes are transmitted more often than other data, laying back the hand-held 
device 200 onto the base station 100 even for a short span of time will be sufficient to update 
PTVN 200 data contents. Having the hand-held 200 on the base 100 for several hours to charge 
the batteries, e.g. over night, there is plenty of time to update all information and even 
application programs inside the hand-held device 200. In addition to information downloaded to 
the hand-held device 200, data, especially configuration information, is also uploaded from the 
hand-held device 200 into the base station 100. This will prevent a totally new installation of the 
hand-held device 200 if the batteries have drained completely. 

Referring now to Figure 2, a block diagram illustrates the internal architecture of the 
remote device (PTVN) 200 of one embodiment of the present invention. Remote device 200 
includes a base station interface 210 for receiving and transmitting data with the base station 100. 
As described above, base station interface 210 may be a conventional IR or RF wireless data 
interface or a conventional hard- wired data connection. Data received by remote device 200 via 
base station interface 210 is fed to microcomputer 220 within remote device 200. 
Microcomputer 220 may then store this information in memory 222. Memory 222 may be a 
conventional dynamic random access memory (DRAM), a static random access memory 
(SRAM), or a non-volatile form of memory such as flash memory or battery-backed CMOS 
memory. Microcomputer 220 and the other electronic components of remote device 220 are 
powered using power supply 224. 

Remote device 200 includes a selection device 230 and output devices including display 
device 240 and speaker 250. Selection device 230 includes an array of function keys, softkeys, 
alphanumeric keys or other input keys for providing user input and command selections. This 
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input is provided through selection device 230 to microcomputer 220. Display device 240 
provides a means by which information and command selections may be displayed on remote 
device 200 to a user. Using a conventional liquid crystal display (LCD) device, microcomputer 
220 can formulate information displays and command selection menus for display on display 
device 240. Display device 240 includes a display control component 242 including logic for 
controlling the display of information on LCD 246. In addition, display device 240 includes a 
display memory (RAM) 244 used for retaining information for display on LCD 246. Speaker 
250 is used to provide output for audible information as controlled by microcomputer 220. 

Optionally, the remote device 200 can be equipped with a reading interface 260 for smart 
cards (SC) and the like or a plug-in module interface 262. The smart cards can be cards with the 
standard magnetic stripe or more advanced with built-in memory or computer chip. Readout may 
be done directly (reading the magnetic information or using contacts for getting the data 
galvanicly off the chip) or indirectly using e.g. inductive or capacitive coupling. In some cases, it 
may be useful to build the interface into the base station 100 (or the set-top box with which the 
remote device 200 is working). 

Such smart cards can be used for identification or they can supply a small amount of (e.g. 
decremented) data to enable services e.g. like telephony cards. Also, a conventional money 
card/cash card may be used to pay for services or load cash onto the card. In the future, SCs may 
be used to store complete software applications, program code and/or data, which is loaded into 
the remote device 200. There, they will run on the built-in hardware and/or simply present the 
data on the card in a special way. Taken to the extreme, the remote device 200 may serve only as 
a user interface, while the actual application runs on the smart card. 

The smart card is useful, especially when the remote device 200 is working with an on- 
line central server. This may be done through a modem in the base station 100 or the set-top box 
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or a special channel (in-band or out-of-band) of the cable system. The remote device 200 then 
typically will be equipped with a wireless communication capability (infrared/radio frequency) to 
the base station to directly interact with the server system at the central point. The remote device 
200 and base station 100 transmission is encrypted like the total communication session (see 
below) for more security. 

The remote device 200 allows operation with different smart cards of different service 
providers. Inserting the smart card into the remote device 200 will activate a suitable mode, e.g. 
starting the selection menu for that special service. In addition, the customers using the remote 
device 200 can be prompted to input the smart card after selecting a special menu item on the 
remote device 200 display 240. The remote device 200 may be used to store personal profiles of 
the customer internally (or externally on the smart card), e.g. the user's sizes of clothing or 
personal preferences. 

After reading the smart card, the user may additionally be asked to identify 
himself/herself through input of a smart card personal identification number (PIN, number, or 
code) for enabling special services. Even more security can be provided if the service access is 
combined with a special PIN for that specific remote device 200. In addition, identification can 
be performed using conventional biometric analysis, fingerprint analysis, or eye scanning 
techniques, instead of or in addition to the above-described PIN technique. 

The latter security model will allow for critical services limited for use only with a 
particular unique remote device 200. This feature is enabled through the unique identification 
number/code of each remote device 200. For example, a "login process" will establish a secure 
(encrypted) communication path with (at least) one known central server. The use of 
conventional ciphered communication will enable secure identification and transactions with the 
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customer. Applying conventional banking standards for encryption and communication protocols 
will enable the remote device 200 to take part in modern home-banking business. 

After identifying himself/herself, the customer will be able to do home-shopping, 
internet-shopping, home-banking, pay for services (as pay TV, (N)VOD, PPV) or other special 
services of his/her conventional set-top box. 

"Logging in", that is additionally identifying the user through PIN and number/code of 
the remote device 200 will set up even further possibilities for the user. For example, the user's 
credit limits granted by the service provider (or via direct bank contact) may be used to allow 
couch-shopping of more expensive goods and services. In addition, identification can be 
performed using conventional biometric analysis, fingerprint analysis, or eye scanning 
techniques, instead of or in addition to the above-described PIN technique. 

Currently, the memory 222 of the PTVN hand-held 200 is designed to meet the 
requirements of the standard EPG navigation purpose. A simple interface for memory expansion 
can be included to cope with new demands. New software applications or updates may be 
downloaded to the hand-held device 200 from the base station 100 if additional expansion 
memory is provided. 

By use of the EPG capability of the present invention, a user of the remote device 200 can 
scan through the available television channels (by channel increment/decrement or input of a 
channel number). Concurrently, a message on the PTVN 200 is displayed to identify the program 
running on that channel at that very moment. The user may receive additional information on that 
program by selection of a function key on the PTVN 200. In this manner, a user can identify 
whether a channel contains something of interest even when a commercial is running on the 
channel. 

The EPG data received contains ranking in terms of the "quality" of a transmission or in 
terms of the content of the program, such as whether the program shows sex or violence. In a 
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special setup mode, the PTVN 200 may be configured to not list programs or to disable switching 
to a channel showing a program above or below a particular quality or content threshold. These 
settings can be password protected so children are unable to change the configuration. 

The PTVN 200 and base 100 hardware normally comes fully equipped with the software 
5 and firmware needed for an application. As each system is individually addressable, as described 
above, broadcast information as well as individual information may be supplied to the base 
station 100 and the PTVN hand-held device 200. Thus, the software in the base station 100 and 
in the hand-held device 200 can be received via external sources just as any other external 
information. 

10 An electronic program guide (EPG) typically does not need a back channel from the 

\U customer's home/business to the information source location. In spite of that, there are a lot of 
y possible applications, which will benefit from the availability of a backward communication 
vk facility. 

o] In the present invention, the telephone network 112 and modem 136 may be used as a 

lJL5 back channel for sending information from the PTVN 200 or base 100 to the information 
l2 provider. Alternatively, the PTVN 200 may use radio frequency (RF) signals via cable as 
*J;j implemented for conventional Pay-Per-View (PPV) services, a cable modem, and/or a separate 
0 channel on the cable. 

Referring to Figure 3, the PTVN 200 is shown removably inserted and electrically 
20 coupled into the base station 100. The PTVN includes a display unit 240 and various function 

keys 310, 31 1, and 312. Menus or selection lists are displayed for the user on display 240. 

Selection can be performed by using (sole or in combination) dedicated keys, so-called 

softkeys and function keys 310 and 311 (functions controlled by contents displayed in the 

display, positioned on any side of the display 240 in any combination, preferably left and right to 
25 the display 240), active display areas (stylus or finger touch selection) and/or voice input. 

Additionally, even such advanced technologies as voice input or eye focussing may be used (by 
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special equipment the direction of the eye's look is detected and used to pick a menu item for 
selection). 

The selection means serve to choose from fixed functions (dedicated keys) or from menus 
displayed on the screen of the PTVN display device 240, the content of which is varying during 
5 the selection process. The menus may be presented in form of selection lists (scrolling or fixed 
lists) or preferably in form of "Ping Pong Menus". The term "Ping Pong Menus", as used herein, 
refers to the selection of one item from a selection list on one side of the display 240 causing a 
new (context dependent) menu or submenu for further selections to appear on the other side of 
the display 240. A further user selection causes the new menu or submenu to appear on the 
10 original side of the display 240. This back-and-forth menu display action resembles back-and- 
^ forth action in a ping pong game. The dual-sided ping pong menu structure also supplies a visual 
cue for the user to find the way back in the menu hierarchy. The selection means may be 
^ designed for use in one- (for left- or right-handers) or two-handed style. 

W The PTVN 200 includes a selection for invoking a "Back" function, which causes the 

si 15 PTVN 200 to redisplay a previous submenu. In this manner, the user may "undo" a current 
selection by using the "Back" selection to go back to a previous menu and making another 
fit selection. In addition, a "Menu" selection is provided by the PTVN 200, which allows the user to 
, S activate the menu hierarchy from the top. In this way, the user can go all the way back to the 

beginning and begin a new sequence of function selections and submenu displays. 
20 Using the PTVN 200 menus, a lot of menu items may be very often selected, others 

seldom or never selected. This user specific selection pattern is recorded in the PTVN 200 to 
enable rearrangement of the menus such that the more interesting (i.e. most often selected) items 
appear on the first (or topmost) positions and/or are presented in more detail. The less interesting 
(i.e. the least often selected) will slide to the lower positions or vanish completely from most 
25 menus (i.e. will only be included in 'all' selections). This automatic adoption of user preference 
may be enabled or disabled by the user. In addition, the user can select explicit preferences (s)he 
wants to see often and explicit preferences may be used to specify the position of the menu items. 
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The memory in the PTVN 200 is limited, so only a certain amount of information 
(program data and additional information related to the programs) can be stored in the PTVN 
200. Most people do not regularly watch all television channels, but use only, say ten channels, 
for example. In this case, the PTVN 200 may store additional information on the transmissions of 
these ten often-viewed channels and less information on the other channels that are seldom 
viewed. The same policy applies to certain types of programs. As user viewing and selection 
habits change, the PTVN 200 adapts itself to the user automatically by tracking current user 
selections. 

The functions and features of the PTVN 200 are primarily built-in. But most of the 
information and data to be processed and displayed will be loaded into the PTVN 200 from an 
external source. Also, the code for special or new functions may be loaded into the PTVN 200 
for temporary or continuos use (software / firmware update). The PTVN 200 may download its 
own software (not only data) thus adapting itself to future needs. 

The sources for additional or external data or code for the PTVN 200 may be via any one, 
but is not limited to one, of the following: 

1) memory card, chip card, smart card, plug-in modules via a smart card interface 260 or a plug- 
in module interface 262; 

2) download over broadcasting networks: TV analog/digital; terrestrial, cable, satellite; VBI, 
dedicated channel, part of information multiplex (digital channel); in-band, out-of-band; 
unidirectional or bi-directional; radio analog/digital (digital audio broadcast - DAB) and other 
RF services like pagers; 

3) download over telecommunication networks: telephone line, RF mobile communication, cable 
modem, and power line networks (i.e. conventional companies, such as Echelon Corp. of Palo 
Alto, Ca. provide broadcast and point to point network communications using modulated signals 
on standard power lines); and/or 

4) download from dedicated computer networks such as local area networks (LAN), metropolitan 
area networks (MAN), or wide area networks (WAN). 
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The base station 100 will work with its own dedicated interface to the above-mentioned 
communication paths in a standalone configuration or the base station 100 can be (partly or 
totally) integrated into conventional analog/digital set-top boxes (STBs), television (TV) sets, 
videocassette recorders (VCRs), personal computers (PCs), or network computers (NCs). The 
PTVN 200 will be coupled to those base station 100 interfaces directly (e.g. galvanicly) or 
communicate via IR or RF connection. 

The PTVN 200 is uniquely "identifiable" using a unique internal number, defined and 
incorporated into the base station 100 and/or each PTVN 200 at the time of manufacture. Thus, 
the PTVN 200 can be used for ordered services. By use of the unique internal number, the PTVN 
100 is able to handle personal profiles ("personifiable") e.g., personal viewing choices on TV, 
own bookmarks for www, personal data, and the like based on the unique internal number. 

Though the primary user-interface for the PTVN 200 is the hand-held display 240, an on- 
screen display on TV set 140 is also possible for example, if several people want to share the 
content (decision what to view, where to go, what to order) displayed by the present invention. 

Though primarily intended for EPG use (electronic program guide), the PTVN 200 can be 
beneficial in a lot of applications as standard user-interface. Examples are given as follows: 

(1) TV, VCR, music radio (EPG): scheduling, navigating, programming, service ordering, 
such as video on demand (VOD), near video on demand (NVOD), pay per view (PPV), impulse 
pay per view (IPPV), and other services; 

(2) remote control (RC) for different TV sets, VCR's, satellite receivers, high fidelity (HI- 
FI) equipment, set-top boxes, and the like; 

(3) terminal for "net-global" and personal messages, uni/bi-directional, email, home 
banking, home shopping, service ordering and the like; 

(4) internet/www access: as navigator to find sites, also to display Web content; 

(5) terminal for information services e.g., cinema/theater/opera schedule and ordering, 
weather forecast (hurricane warning), local news/events/activities, public information (opening 
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hours ...), sport scores, stock quotes, traffic (jam, airport information), games, commercials, and 
the like; 

6) calendar, reminder, personal database; 

7) remote control for household appliances: kitchen, air condition, heating, security, and 
the like; and/or 

(8) portable intelligent phone or video phone (if wireless base station communication). 

In conventional analog cable systems, the present invention needs access to a specified 
channel, which carries its information in the VBI. There is a conflicting situation if that channel 
is not reachable because there is a cable TV structure where only one channel can be viewed at a 
time. Fortunately all households can receive one of a defined set of channels. So if the PTVN 200 
data is traveling on the VBI of one of those channels and the base station has its own 
tuner/reception capability, continuous data transport is guaranteed. 

As the channel mapping throughout the U.S. is not always consistent, the present 
invention may need to identify the channel map to use in an actual system. If channel 
programming or the multiple service operator (MSO) may automatically be recognized, the tuner 
120 in the base station 100 will scan the available channels to get the necessary information. 

All the PTVN 200 external information is received/transmitted in encoded format via data 
packets in the VBI of one or more channels or via the telephone network 112 or 
received/transmitted via the telephone network 112 alone. The information is received by the 
tuner 120 or modem 136 in the base station 100 that is individually addressable. If the service is 
enabled, data is fed to the hand-held PTVN 200, which the customer will use to navigate through 
the programming information received by the tuner 120 or modem 136. 

In an alternative embodiment of the present invention, the data transport via VBI is 
replaced by the use of the telecommunication network alone. This embodiment is illustrated in 
Figure 54. Note that the tuner 120, the decoder 122 and all antenna related parts can be omitted 
from the base station 100. Instead, a conventional modem 136 alone has been included. 
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From a cost point of view, the remote device 200, if only used for TV schedule 
navigation, needs only a simple conventional modem, e.g. 14400 bps (bits per second). 
Downloading, for example, 256 Kbytes of new data will take approx. 3 minutes, which is fast 
enough in most situations. However, thinking of more robust features, especially WWW-access, 
a faster modem (up to 56 kBaud) would be more desirable. 

At least one server must be installed to supply the remote device 200 with information 
transmitted over the Internet. One can start with a very simple server, which will grow 
proportionally to the number of subscribers. At some later time, several servers spread over the 
U.S. or other countries will be helpful. 

The server for a remote device 200 is connected, through base station 100, with at least 
one Internet service provider (ISP) to allow access to the Internet through a user's dial-in points 
(local call) for the remote devices 200. During certain low-traffic time, the remote devices 200 
installed will, in a randomly distributed fashion, call the ISP to get in contact with the server for 
the remote device 200. 

Once a remote device 200 reaches the server, a secure communication session is opened 
to exchange data in a secure fashion. A remote device 200 identifies itself by sending its unique 
number/code. The secure communication session may also be the basis for additional services. In 
one embodiment, the unique number/code can only be used one time per day to receive new data. 
This procedure additionally secures the system from illegal hardware clone systems. In some 
cases, the remote device 200 may also be called directly by a central system to initiate the 
communication session from the server side. 

The external data the remote device 200 may receive depends on the services to which the 
particular customer has subscribed. In addition to the automatic dial-in during off-peak hours 
(e.g. during the night), the server can be called manually by the customer using the remote device 
200 to get immediate updated external information (e.g. sports scores, news headlines, etc). 

Figures 4 through 11 are flowcharts illustrating processing logic performed by the 
firmware or software within base station 100 and remote device 200. As would be apparent to 
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one of ordinary skill in the art, this software or firmware can reside in memory 131 in base 
station 100 and be executed by microcontroller 130. Also, the firmware and software can reside 
in memory 222 of remote device 200 and be executed by microcontroller 220. It will also be 
apparent to one of ordinary skill in the art that the functionality described herein may be 
5 equivalently implemented on either base station 100 and/or remote device 200 or a remote device 
200 combining the functionality of both base station 100 and remote device 200. 

Referring now to Figure 4, a flow diagram illustrates a processing logic performed with a 
remote device 200 when a function key 230 is activated. In processing block 410, 
microcontroller 220 waits for user interaction with one of the function keys 230. When a user 
10 presses one of the function keys 230, microcontroller 220 receives the key activation in 
IP processing block 415. For example, the user may have entered a key activation corresponding to 

4;: a "type" menu item. In processing block 420, microcontroller 220 scans the function key matrix 

bi 

4:; 230 either directly or indirectly through a specialized integrated circuit. Such keyboard matrix 
y integrated circuits are well known to those of ordinary skill in the art. In processing block 425, 
.T5 microcontroller 220 detects and identifies the key depressed by the user. In processing block 
430, microcontroller 220 performs a lookup to determine the current mode and status 
; ~ corresponding to the depressed key using internal tables stored in memory 222. Using these 
tables, microcontroller 220 identifies a next step to perform in response to the key depression. 
For example, microcontroller 220 may display a submenu on the opposite side of the screen 
20 display on display device 240. This submenu would correspond to the menu item selected by the 
user. For example, the submenu may correspond to the "type" menu item. In processing block 
435, microcontroller 220 writes the submenu corresponding to the menu item selected by the user 
into display memory 244. The selected menu item on the original side of the display device 240 
is emphasized or highlighted to identify the selected menu item. In processing block 440, 
25 microcontroller 220 sets the appropriate mode or status indicators to correspond to the selected 
menu item. This action configures the software to accept the next user selection. As a result, a 
list of program(s) corresponding to the user selections is displayed and processing flow loops 
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back to processing block 410 where microcontroller 220 waits for the next user function key 
activation. 

Referring now to Figure 5, a flowchart illustrates the processing logic performed by base 
station 100 when it receives external information from cable provider 1 10 via the VBI portion of 
the video and data transmission from cable provider 110. Similar processing logic could be 
performed for external information received via telephone network 1 12 and modem 136. 

In processing block 510, microcontroller 130 initializes decoder 122 for continuous 
reception of specific data in the form of pages or subpages. Tuner 120 is tuned to a dedicated TV 
channel to receive this data. In processing block 515, microcontroller 130 waits for data detected 
and decoded by decoder 122. In processing block 520, decoder 122 receives data from cable 
provider 110 through tuner 120. Decoder 122 signals microcontroller 130 of the reception and 
data. In processing block 525, microcontroller 130 reads the data provided by decoder 122 and 
enables decoder 122 to receive the next data transfer. In processing block 530, microcontroller 
130 checks that the received data is error free by checking the parity bits, hamming bits, cyclic 
redundancy check, and/or other commonly used methods for validating the integrity of 
transferred data. In processing block 535, microcontroller 130 decrypts the received data and 
determines the type of the received data. In processing block 540, microcontroller 130 processes 
the data according to its type and according to the previously configured system parameters, 
which enable or disable the processing of particular messages or data types. The processing 
performed in processing block 540 is described in more detail in connection with Figures 6 
through 11 as described below. Once microcontroller 130 processes the received data in 
processing block 540, processing loops back to processing block 515 where microcontroller 130 
waits for the next data transmission. 
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Referring now to Figure 6, the processing performed on external messages received by 
base station 100 is illustrated. As can be seen in Figure 6, external messages received by base 
station 100 in one embodiment can contain three types of addressing. In the first addressing type, 
the message can contain the address of an individual base station 100. In this situation, the 
addressed base station will process its own messages addressed to itself. In a second type of 
addressing, an external message may address a group of base stations 100. In this situation, a 
particular base station 100 that is a member of the addressed group will process these types of 
messages. In the third type of addressing, external messages may be identified as broadcast 
messages for all base stations 100. In these situations, any base station 100 receiving a broadcast 
message will process the message. Referring now to decision block 610 illustrated in Figure 6, 
the external message is tested for the presence of a specific address corresponding to the 
individual base station 100 processing the message. If the message addresses that particular base 
station 100, processing block 615 is performed and the external message is decoded and 
processed as will be described in more detail in Figures 7 and 8. In decision block 620, the 
message is tested for the presence of a group identifier corresponding to a group to which this 
particular base station 100 may be a member. If this particular base station 100 is a member of 
the addressed group, processing block 625 is performed. Address group message processing is 
described in more detail in connection with Figure 9. In decision block 630, the external 
message is tested for the presence of broadcast addressing. If the received message is a broadcast 
message, processing block 635 is performed. The broadcast message processing is described in 
more detail in connection with Figure 10. Having completed processing for the incoming 
external message, processing terminates at end block 690 illustrated in Figure 6. 

Referring now to Figures 7 and 8, the processing logic performed for processing an 
incoming external message addressed for a particular base station 100 is illustrated. Referring to 
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Figure 7 and decision block 710, if the incoming message is an enabling/disabling message, 
processing block 715 is performed. In this case, the appropriate control bits in internal secure 
memory are set or reset corresponding to the information in the enabling/disabling message. 
Processing then terminates at end block 790. If the incoming external message is a control 
message (decision block 720), the appropriate modes/parameters corresponding to information in 
the control message are set or reset accordingly (processing block 725). Processing terminates at 
end block 790. If the incoming external message is a personal message (decision block 730), the 
personal message is stored in local memory 131 for later transfer to remote device 200 or for 
direct transfer to remote device 200 if communication with remote device 200 is currently 
possible. Processing terminates at end block 790. If the incoming external message is a base 
station 100 software/firmware download message (decision block 740), the software/firmware 
download data is checked for correctness or any presence of data corruption. If the incoming 
download is valid, the local base station 100 firmware or software is updated with the download 
data (processing block 745). Processing terminates at block 790. If the incoming external 
message is not any of the types of messages corresponding to those tested in decision blocks 710, 
720, 730, or 740, processing continues to the bubble labeled A illustrated in Figure 8. 

Referring now to Figure 8, the incoming external message is tested in decision block 810. 
If the incoming message is a remote device software/firmware control code message, the control 
code is stored in memory 131 for later transfer to remote device 200. Alternatively, if 
communication with remote device 200 is currently possible, the received control code is 
transferred directly to remote device 200 where the control code is applied. Upon completion of 
the processing in processing block 815, processing terminates at end block 890 illustrated in 
Figure 8. 
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Referring now to Figure 9, the processing performed by base station 100 for group 
address messages is illustrated. In decision block 910, the incoming external message is tested. 
If the incoming message is a local area message or local area data, processing block 915 is 
executed. In this case, the local area message or local area data is transferred to remote device 
200 or queued for later transfer to remote device 200. Processing then terminates at end block 
990. If the incoming message is a control message (decision block 920), the appropriate 
modes/parameters are set or reset in processing block 925. Processing terminates at end block 
990. If the incoming group address message is a base station 100 software/firmware download 
message (decision block 930), the incoming download is verified for correctness in processing 
block 935 and the base station 100 memory is updated to correspond to the downloaded 
information. Processing terminates at end block 990. If the incoming group address message is a 
remote device software/firmware/control code download message (decision block 940), the 
software, firmware, or control code is transferred to remote device 200 or queued for later 
transfer to remote device 200 when communication is available (processing block 945). 
Processing terminates at end block 990. 

Referring now to Figure 10, the processing performed by base station 100 for an 
incoming broadcast message is illustrated. In decision block 1010, if the incoming broadcast 
message is a general message or general data, the general message or general data is transferred 
to remote device 200 or queued for transfer to remote device 200 when communication is 
possible (processing block 1015). Processing terminates at end block 1090. If the incoming 
broadcast message is a control message (decision block 1020), the appropriate modes/parameters 
are set or reset in processing block 1025. Processing terminates at end block 1090. If the 
incoming broadcast message is a base station software/firmware download message (decision 
block 1030), the download data is verified for correctness in processing block 1035 and the local 

23 



03393.P002X PATENT 

base station 100 code is updated. Processing terminates at end block 1090. If the incoming 
broadcast message is a remote device software/firmware control code download message 
(decision block 1040), the software/firmware or control code is transferred to remote device 200 
or queued for later transfer to remote device 200 when communication becomes possible 
(processing block 1045). Processing terminates at end block 1090. 

Referring now to Figure 11, the processing logic performed by remote device 200 is 
illustrated. Li decision block 1110, the incoming external message received by remote device 
200 is tested. If the incoming data is a message, processing block 1115 is executed. If the 
incoming message is an urgent message, the message is displayed immediately to the user and 
acknowledgement by the user is requested. If the incoming message is not an urgent message, 
the message is stored for automatic or manual recall if the remote device 200 is later used by the 
user (processing block 1 1 15). Processing terminates at end block 1 190. If the incoming external 
data is bulk data (decision block 1 120), processing block 1 125 is executed. If the bulk data is 
related to programming changes in remote device 200, the old data in remote device 200 is 
marked as invalid and the changes are stored. Automatic and/or manual recall of information 
about the changes is set up within remote device 200. If the bulk data is new/additional data, the 
new/additional data is stored for processing in remote device 200 (processing block 1125). 
Processing terminates at end block 1190. If the incoming data is a remote device 
software/firmware/control code download (decision block 1130), the download data is verified 
for correctness in processing block 1135. Subsequently, the validated download is stored in 
remote device 200 as updated code. Processing terminates at end block 1 190. 

Referring now to Figures 12 through 53, the figures illustrate the various screen displays 
and function key manipulations available on the remote device 200 of one embodiment of the 
present invention. As illustrated in Figure 12, a user interface and menu 1200 is illustrated. 

24 



03393.P002X PATENT 

Such a menu can be displayed on display device 240 in remote device 200 of one embodiment. 
In the present invention, each menu is configured with at least two sets of menu items in a 
distinct display area on remote device 200. For example, as illustrated in Figure 12, a first 
display area 1210 contains a vertical arrangement of menu items available for selection by a user 
using function keys 310 as illustrated in Figures 3A, 3B, and 3C. Similarly, the menu 1200 
shown in Figure 12 includes a second display area 1215 containing a second vertical arrangement 
of menu items. As consistently applied throughout the user interface in the present invention, the 
menu items in menu 1200 in one display area corresponds to a user selection of a particular menu 
item in a different display area. For example illustrated in Figure 12, a menu item 1225 in first 
display area 1210 has been selected by a user. In response to the menu item selection 1225, the 
submenu selection items in second display area 1215 are displayed. As shown in Figure 13, the 
selection of a different menu item 1325 causes a different set of submenu items to be displayed in 
second display area 1215. Similarly, other menu selections in first display area 1210 cause a 
corresponding presentation of submenu items in second display area 1215. 

Referring again to Figure 12, menu 1200 also includes a third display area 1220. Third 
display area 1220 is a status display area for presenting information corresponding to the history 
of the most recent series of command selections. Using the status area 1220, the user may 
quickly determine where he/she is in a command selection hierarchy. The information presented 
in status area 1220 will become more clear in the description of the menus that follow. In the 
example illustrated in Figure 12, the phrase "TV-program" displayed in status area 1220 
corresponds to a current mode, which in this example, is a mode for selection of TV 
programming (as opposed to the selection of TV remote control (RC) or video cassette recorder 
(VCR) modes, and the like). The status area 1220 is also used to display a history of menu 
selections as will be apparent in the examples that follow. 
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Referring again to Figure 12, the menu items illustrated in the first display area 1210 
correspond to the initial set of command or function options available in one embodiment of the 
present invention. These commands or functions support the functionality of remote device 200 
for enabling a user to easily and efficiently manage the selection of video programming and data 
available from a cable provider 110. The first such menu item is the "Topic" menu. The 
"Topic" menu item enables a user to select the type of television programming desired. As 
shown in Figure 12, the types of topics available in one embodiment include movies, sports 
programming, entertainment programming, music programming, or current affairs programming. 
It will be apparent to one of ordinary skill in the art that other types of programming options or 
topics may be displayed and selected in equivalent alternative embodiments. In a second menu 
item of the list of items in first display area 1210, the "Time" menu item is available. The 
"Time" menu item enables a user to identify a time frame of interest during which various 
programming options are available. The submenu options corresponding to the selection of the 
"Time" menu item is illustrated in the second display area 1215 shown in Figure 13. For 
example, once a user has selected a menu item from the first display area 1210, such as the 
"Time" menu item 1325, the user may subsequently select one of the submenu items presented in 
the second display area 1215. If, for example, the user selects the "Now" submenu item 1330, 
the resulting display for this example is illustrated in Figure 14. Referring now to Figure 14, note 
that the information displayed in status area 1220 identifies the first menu item selected ("Time") 
followed by the second submenu item selected ("Now"). The information displayed in status 
area 1220 thereby identifies the chain of command or menu item selections made by a user. The 
information display 1400 illustrated in Figure 14 corresponds to the example of a user selection 
of a "Time" menu item followed by the selection of a "Now" submenu item. As a result of these 
user selections, the display area 1410 identifies at least a portion of the television programming 
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available at the present time. In one embodiment, the information display 1410 identifies the 
time when a particular program will start, the channel or network upon which the program will 
be televised, and a title identifying the content of the program. It will be apparent to one of 
ordinary skill in the art that additional or augmented information associated with the available 
individual programs may similarly be displayed with an information display 1410. In a further 
opportunity for user interaction, the user may individually select one of the programming options 
identified in information display 1410. In the example shown in Figure 14, a user has selected 
the fifth programming option 1415 causing this option to be highlighted or uniquely displayed to 
identify the selected programming option. As a result of this programming option selection and 
the activation of a softkey titled "Mo" 1417, a resulting display, as shown in Figure 15, provides 
more detailed descriptive information on the selected program. It will be apparent to one of 
ordinary skill in the art that additional information may be provided for the programming 
illustrated by example in Figures 14 and 15. In one embodiment, an overlay window or display 
area 1510 is used to present the additional programming information to the user. Upon the 
appropriate command option selection, the information window 1510 will be removed and the 
user allowed to identify other programming selection options. 

Referring now to Figure 16, a menu 1600 similar to the menu illustrated in Figure 12 is 
shown. As described and illustrated in connection with the example of menu 1200, the first 
display area 1210 and second display area 1215 operate as a ping-pong style menu. For example, 
a list of menu items is presented in first display area 1210. The user is prompted to select one of 
these menu items using corresponding function keys 310 in proximity to the first display area 
1210. By highlighting one of the menu items in first display area 1210, a corresponding list of 
submenu items corresponding to the highlighted menu item is displayed in the second display 
area 1215. Once the selection of a menu item in the first display area 1210 is made using 
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function keys 310 and the corresponding submenu items are displayed in second display area 
1215, the present invention allows the selection of one of the submenu items in second display 
area 1215 using a second set of function keys 31 1 in proximity to the second display area 1215. 
As shown in the example illustrated in Figure 16, the user has first selected menu item 1225 in 
first display area 1210 using function key 1605. As a result, submenu items are displayed in the 
second display area 1215. The user may now select one of these submenu items using function 
keys 311. In the example of Figure 16, the user has selected the "Entertainment" submenu item 
1610 using function key 1615. The resulting display is illustrated in Figure 17. 

Referring now to Figure 17, the menu items in first display area 1210 have been replaced 
with new submenu items corresponding to the selection 1610 made in second display area 1215. 
Each of the submenu items now displayed within first display area 1210 corresponds to options 
related to selected menu item 1610 from second display area 1215. At this point, the user may 
select one of the submenu items within first display area 1210 using one of the function keys 310. 
In the example shown in Figure 17, the user activates the function key 1705 associated with the 
first menu item displayed in first display area 1210. As a result, the menu illustrated in Figure 18 
is displayed. 

Referring now to Figure 18, a menu is displayed which corresponds to the activation of 
function key 1705 illustrated in Figure 17. Because in the example illustrated in Figures 17 and 
18, the first submenu item 1810 in first display area 1210 has been selected, the corresponding 
submenu is displayed in second display area 1215 as shown in Figure 18. Again, the user may 
select one of the submenu items in second display area 1215 by activating the corresponding 
function key within the set of function keys 311. In the example illustrated in Figure 1 8, the user 
activates function key 1805. As a result, the menu illustrated in Figure 19 is displayed. As 
shown in Figure 19, the menu items displayed in first display area 1210 have been replaced with 
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submenu items corresponding to the menu item 1910 selected from the second display area 1215. 
The user may then use one of the function keys 310 to select one of the menu items under first 
display area 1210. In the example illustrated in Figure 19, the user selects function key 1905 to 
select the fifth menu item displayed in first display area 1210. As a result, the display illustrated 
in Figure 20 is displayed. As shown in Figure 20, the selection of menu item 2010 from first 
display area 1210 causes the resulting display of corresponding submenu items within second 
display area 1215. The user may then use one of the function keys 311 to select one of the 
submenu items displayed in second display area 1215. In the example illustrated in Figure 20, 
the user activates function key 2005, which results in the display shown in Figure 21. As a result 
of activation of the function key corresponding to the selection of an hour, a message is displayed 
to the user prompting the user to enter the time and confirm the time entry as shown in Figure 21. 
The user may then enter the time using number keys or alternatively using a special numeric 
softkey menu. The user then confirms the time entry using function keys available on remote 
device 200. 

As shown by the menu samples illustrated in Figures 16 through 21, the user is able to 
navigate through a hierarchy of menus and submenus by bouncing back and forth between a first 
display area and a second display area using a first set of function keys 310 and a second set of 
functions keys 311. This ping-pong menu concept of the present invention provides an efficient 
and fast way to navigate through a set of menu items. With each activation of a function key as 
illustrated in Figures 16 through 21, information identifying the activated function is sequentially 
illustrated in status area 1220. The information in status area 1220 assists the user in orienting 
himself/herself during a sequence of function key activations. 

Referring now to Figure 22, a menu illustration example shows the result of the entry of a 
time prompted in the example shown in Figure 21. In this example, the user responded to the 
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prompt for the entry of a time by entering the hour "17:20". In response to this, the display 
shown in Figure 22 is presented for the user. Because the user entered a time corresponding to 
"17:20", programming available from the cable provider 110 at the specified hour is illustrated 
line by line on the display device 240 of remote device 200. Note that the information displayed 
in status area 1220 has been updated to indicate the user's entry of the specific time. The present 
invention also includes a "Mark" function that allows the user to mark particular programs and to 
be reminded of the imminent broadcast of a marked program or programs. This feature is 
described in more detail below in connection with Figures 44-46. 

Referring now to Figures 23 and 24, the examples illustrate the operation of the present 
invention for selecting a particular programming for recording using a video cassette recorder 
(VCR) or other recording means. Referring to Figure 23, the display presented for the user 
includes a listing of television programs, channels upon which those television programs are 
available, and times when those television programs will be aired. In the example shown in 
Figure 23, the user has manipulated the available function keys on remote device 200 to select a 
particular television program 2305. Having selected the specific program 2305 as shown in 
Figure 23, the remote device 200 may obtain the appropriate control information from internal 
tables to program a VCR to record the specified program. Additionally, an informational 
message is displayed for a user such as the message illustrated in Figure 24. 

Referring now to Figures 25 through 29, an example illustrates the operation of the 
present invention for selecting the display of programming to be shown on a particular channel 
during a particular timeframe. In the example shown in Figure 25, the user selects menu item 
2510 using function key 2505. As a result, the program station list 2610 as illustrated in Figure 
26 is displayed. The user may then select, using cursor keys (up/down/left/right) on the remote 
device 200, a particular channel of interest such as channel 2615 as shown in Figure 26. As a 
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result of this selection, the channel list 2610 is removed and the display illustrated in Figure 27 is 
presented for the user. In this case, the user has selected the station function and the particular 
station of interest. In this case, the user is prompted to enter a particular time frame of interest. 
In the example shown in Figure 27, the user selects menu item 2710 using function key 2705. As 
a result, the information displayed in Figure 28 is presented for the user. Referring now to Figure 
28, the user selects menu item 2810 using function key 2805 as shown in Figure 28. As a result, 
the information as illustrated in Figure 29 is illustrated for the user. According to this sequence 
of function key activations, the user has selected a particular station and a particular time frame 
corresponding to programming provided on that station. The list of information corresponding to 
this programming query is illustrated for the user as a list of programs available on that channel 
at the specified time frame. 

Referring now to Figures 30 through 34, an example illustrates the operation of the 
present invention for selecting a particular program containing a specified characteristic. In this 
example, the present invention executes a query to determine a particular specified movie having 
a particular specified actor associated with that movie. 

Referring now to Figure 30, the user activates the menu item 3010 using function key 
3005. As a result, the menu illustrated in Figure 31 is displayed for the user. As shown in Figure 
31, the user then selects menu item 3110 using function key 3105. As a result, the information 
displayed for the user is illustrated in Figure 32. In this case, the user is presented with an 
alphabet with which he/she can type in the keyword associated with the desired characteristic. 
Other ways of character input are conceivable/possible. In this example, the user can enter the 
name of the actor of interest in the window 33 10 shown in the example of Fig. 33. Only a single 
character, or a few initial characters of the name may be needed to uniquely identify the selection 
or the name may be selected from the list in the additional selection window 3312 shown in the 
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example of Fig. 33. The complete name is filled in automatically after a number of characters 
have been entered to uniquely identify the selection. Once this is complete, the information 
displayed is illustrated in Figure 33. In this case, a particular actor has been identified to the 
system using the alphabetic menu display. As a result of the entry of this keyword, the present 
invention searches for programming containing the keyword and corresponding characteristic. 
Having found matching programming, the information is displayed such as the information 
display illustrated in Figure 34. Again, note that the status area 1220 illustrates the sequence of 
key activations up to the present point. 

Figures 35 through 37 illustrate the operation of the present invention for entering a code 
number associated with a particular television program. In Figure 35, a user selects menu item 
351 1 using function key 3505. The result of this user action is illustrated in Figure 36. In Figure 
36, a message is displayed to the user to prompt the user to enter the appropriate code number. 
In one embodiment, such code numbers include a two-digit channel field, a one-digit day of the 
week field, and a four-digit time field comprising two digits per hour and two digits per minute. 
In response to this prompt message, the user enters the desired code number using function keys 
available on remote device 200. The result of this user action is illustrated in Figure 37. In 
Figure 37, the particular television program associated with the user-entered code number is 
displayed on the display device 240. 

Referring now to Figures 38 through 43, a set of menu displays illustrate the operation of 
the present invention for saving an often-used course of selection or for storing personal 
preferences. As an initial step to invoke this functionality, the user selects menu item 3810 using 
function key 3805. The result of this user action is illustrated in Figure 39. The save function 
allows a user to record a sequence of user function key activations and associate a name with the 
particular sequence of actions. Once a user has performed the selection process, such as the 
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selection of a particular personal preference, one single time and named the sequence of 
selections, e.g., MUSIC, the user may simply press "Recall" and "MUSIC" to receive a list of 
programs that meet these particular qualifiers according to the preselected user preferences. As 
described below, the user can delete a personal preference not needed any longer. 

In Figure 39, the user is prompted to begin this sequence of user activations. In the 
example of Figure 39, the user begins by activating menu item 3910 using function key 3905. 
The result of this action is illustrated in Figure 40. As a result of the user activation of menu 
item 3910, the menu items on the opposite side of the display (i.e. first display area 1210) are 
replaced with submenu items corresponding to the user selection of menu item 3910. The user 
may now use one of the function keys 310 to activate a menu item in display area 1210. In the 
example of Figure 40, the user selects menu item 4010 using function key 4005. The result of 
this user action is illustrated in Figure 41. In Figure 41, it can be seen that the menu items in the 
display area on the opposite side (i.e. second display area 1215) are replaced with submenu items 
corresponding to the selection of menu item 4010. Note that status area 1220 has been updated 
to identify the sequence of menu selections entered by the user so far. At this point, the user may 
select one of the menu options in display area 1215 using function keys 311. In the example of 
Figure 41, the user selects menu item 4110 using function key 4105. The result of this user 
action is illustrated in Figure 42. Having completed a sequence of user actions, the user is 
prompted by the message illustrated in Figure 42 for the entry of a name of the recorded 
sequence of user actions. The user may use the alphabetic characters and function keys to enter a 
user defined name for the sequence of user actions. The entered name is recorded and the 
programs associated with the sequence of user actions are displayed as illustrated in Figure 43. 

Referring now to Figures 44 through 46, a set of menu displays illustrate the operation of 
the present invention for recalling a list of marked programs. By selecting the recall function and 
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pressing the appropriate softkey (e.g., MUSIC) complex selection steps may be reduced to very 
few keystrokes. As illustrated in Figure 44, the menu item 4410 is selected using function key 
4405. The result of this user action is illustrated in Figure 45. As illustrated in Figure 45, a set 
of user defined categories of previously marked programs is illustrated in second display area 
1215. In the example of Figure 45, the user selects menu item 4510 using function key 4505. As 
a result, a list of marked programs is displayed as illustrated in Figure 46. A marked program 
may be selected and additional information requested or programmed into the VCR. 
Additionally, a delete softkey allows removal of the marked program from the list if it is not of 
interest anymore. Marked programs of the past may be automatically deleted. 

Referring now to Figures 47 through 51, a set of menu displays illustrate the operation of 
the present invention for deleting the complete list of marked programs or personal programming 
selections. Referring to Figure 47, a user invokes this functionality by selecting menu item 4710 
using function key 4705. The result of this user action is displayed in Figure 48. As illustrated 
in Figure 48, the menu items in second display area 1215 have been replaced with a list of 
marked programs or personal selections as a result of the selection of menu item 4710. In an 
alternative example, Figure 49 illustrates an alternative example of the menu display as a result 
of the activation of menu item 4710. As shown in Figure 49, the user selects the "delete" menu 
4910 using function key 4905. As a result, a message is displayed for the user as shown in 
Figure 50. This message prompts the user to select the personal selection or marked program to 
delete. In the example of Figure 50, the user selects item 5010 for deletion using function key 
5005. As a result of this user action, the user receives a message asking for confirmation of the 
deletion as illustrated in Figure 51. In response to this prompt for confirmation, the user 
activates a predefined function key such as an "OK" button to confirm the deletion. As a result 
of this action the marked program or personal selection is deleted. 
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Referring now to Figures 52 and 53, other menu displays illustrate the operation of the 
present invention for controlling a television monitor and/or a video cassette recorder (VCR). In 
Figure 52, various menu items are displayed in first display area 1210 and second display area 
1215. These menu items correspond to standard functions provided on conventional VCRs. Any 
of these functions can be selected using function keys 310 or 31 1 provided on remote device 200. 
As a result of the activation of one of these menu items, remote device 200 emits well-known 
infrared coded signals to invoke the selected function in the VCR. Similarly as illustrated in 
Figure 53, menu items corresponding to standard functions in a conventional television set are 
displayed in first display area 1210 and second display area 1215. These functions may also be 
selected using function keys 310 or 311. In similar fashion, the remote device 200 emits IR 
signals to the television receiver corresponding to the selected function. In this manner, remote 
device 200 can be used to control a standard VCR or television set. 

Personal Video Viewer and Remote Control Device 

In an alternative embodiment of the present invention, the remote device 200 is 
configured to receive video programming signals via the base unit 100. Video content 
represented by the video programming signals are displayable and viewable on the display device 
of remote device 200. In this embodiment, the hand-held remote device 200 has several 
functions, including the presentation of video content, the use as an electronic program guide 
(EPG) or the application as a remote control (RC) for devices in the customer's home. The 
remote device 200 can operate in at least two modes: a video viewing mode, and an EPG 
selection or control mode. The base unit 100 provides services for the hand-held remote device 
200, such as for example, delivering audio and video signals in the video viewing mode or 
external data and information for the EPG mode. As described above, the base unit 100 also 
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services as a charging station for the batteries in the hand-held remote device 200. 
Communication between hand-held remote device 200 and base unit 100 is accomplished by 
radio frequency (RF) transmission/reception in one embodiment. It will be apparent to those of 
ordinary skill in the art that other conventional forms of wired or wireless communication 
5 between the hand-held remote device 200 and the base unit 100 can be equivalently 

implemented. Further, it will be understood that the video programming signals referred to herein 
include video and/or audio signals originated from a television or radio broadcast, a video and/or 
audio capture device such as a camera or microphone, or conventional recording devices for 
recording and retransmitting video and/or audio signals. In addition, the video and/or audio 

O 

~" |p content need not come only from an attached television set or a built-in video tuner. Additional 
^ sources of video and/or audio content used with the present invention include, but are not limited 
(J to, standard video tape players {such as VCRs}, CD-ROM players, DVD or DIVX players, 
B digital video, audio, or image data (e.g. *.mpg, *.avi, *.mp3, etc.) maintained on a computer 

I wis: 

h * permanent storage device, such as a hard disk or flash memory, video and/or audio data delivered 
IV5 via a network, or other conventional video and/or audio media including smart cards, memory 
^ modules (e.g. PCMCIA, Sony Memory Stick, etc.). The necessary playing and/or decoding 

hardware and/or software may reside in attached appliances and/or may be built into the base unit 
and/or the hand-held remote device of the present invention. Further, the video signal 
form/coding is not restricted to conventional standards like NTSC or PAL, or mono/stereo for 
20 audio. Other signal coding may be equivalently used, such as for example, MPEG-coded digital 
TV/audio signals. In this case, the MPEG decoder may reside in the base unit and/or in the hand- 
held remote device. 



36 



03393.P002X PATENT 

The following sections set forth a detailed implementation of the hand-held video viewer 
and remote control device of this embodiment of the present invention (denoted herein as the 
Personal TV system 5500). 

The principal application of the Personal TV system 5500 is shown in Figure 55. The 
base unit 5512 is connected to the conventional television set 5510 via a conventional SCART 
cable. Alternatively, other well-known video connector/cable systems could alternatively be used 
instead of SCART. By connecting the base unit 5512 to the television set 5510 in this way, the 
base unit 5512 can capture the current video and audio signals of the TV set 5510 and transmit 
these video programming signals via radio frequency (RF) communication to the hand-held 
remote device 5514 for rendering as video content on the display device 240 and the speaker 250 
of the hand-held remote device 5514. In one embodiment, the display device 240 is a liquid 
crystal device (LCD) screen and the audio output is passed to a conventional built-in speaker 
250. Alternatives for the LCD screen include organic displays, plasma displays, or other suitable 
mobile display units. Additionally, the audio output may be passed to an earphone plugged into 
to an earphone jack on remote device 5514. 

Referring to Figure 57, a block diagram illustrates the components of the hand-held 
remote device 5514 in this embodiment. In addition to display 5724 and speaker 5731, the hand- 
held remote device 5514 provides function keys 5732, which may be used to select a mode in 
which the hand-held remote device 5514 operates. The function keys 5732 are described in more 
detail above. Additionally, the function keys 5732 serve as navigation and function selection keys 
(denoted softkeys) in special modes. An IR (infrared) transmitter 5727 assists in controlling the 
TV set 5510 and other devices in the household using conventional IR function codes. An 
optional smart card reader 5734 can be used to identify the current remote device user when 
operating the system in applications requiring such functionality. For example, a smart card can 
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be used in certain electronic commerce transactions in which the hand-held remote device is 
employed. 

The RF communication (receiver 5712) and the batteries 5742 make the hand-held 
remote device 5514 mobile and independent. The hand-held remote device 5514 receives 
transmitted signals from the base unit 5512 at receiver 5712. Spread spectrum decoder 5714 and 
data slicer/clock control unit 5716 are used to split the input signal into a display (television 
video/processor generated image) portion, an audio portion, and a data portion. The display 
portion (optionally with or without a graphic overlay) is sent to image memory controller 5718 
for storage in the double buffered image memory 5722 for display on the display component (i.e. 
display controller/driver 5720 and LCD display 5724) of the hand-held remote device 5514. The 
audio portion is sent to digital-to-analog converter and audio controller unit 5728 for output to 
speaker 5731. The data portion can either be sent to the smart card interface 5737 for control of 
or transfer to smart card reader 5734 or the data portion can be sent to the IR interface 5726 for 
transfer through the IR transceiver 5727/5729. Key controller 5730 receives key input from the 
user of the hand-held remote device 5514 via keys 5732 and transfers these key selections to the 
base unit 5512 via data multiplexer 5736, spread spectrum coder 5738, and RF transmitter 5740. 

Within a radius comparable to that of conventional wireless telephones, the hand-held 
remote device 55 14 may be used as a mobile TV set allowing a user to watch TV anywhere in the 
house or the garden. This feature of the present invention allows one to watch a television 
program in another room where no TV set is installed or just to be mobile until a special program 
is about to begin or restart. Another application of the present invention is controlling the 
content, which is currently being consumed at the standard TV set. For example, this feature 
gives parents the opportunity to check the programming content the children are looking at from 
anywhere in the house. 
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Again, comparable to wireless telephones, the hand-held remote device 5514 is coupled 
to the base unit 5512 every time the remote device is not being used. This will allow charging of 
the batteries 5742, which power the hand-held remote device 5514. Having the hand-held 
remote device 5514 regularly engaged on the charging cradle of the base unit 5512 ensures that 
there will be enough power in the batteries 5742 for the next utilization. The base unit 5512 
receives its power from the normal wall outlet via a standard power cord. 

One important function of the Personal TV system 5500 of the present invention is to 
enable a user to watch a TV program on the LCD screen of the hand-held remote device 5514 
(and listen to the sound through the built-in speakers 5731). This television program is the same 
program as the one on the standard TV set to which the base unit 5512 is connected. The video 
and audio signals travel to the base unit 5512 using a SCART (or other comparable) cable. In an 
embodiment for which the base unit 5512 does not itself have a video tuner 5616, the current 
programming for the LCD display on the hand-held remote device 5514 is selected locally on the 
TV set. The audio volume may be adjusted directly on the hand-held remote device 5514 using 
function keys. By use of an IR adapter 5652 connected to the base unit and positioned in front of 
the TV set, some parameters of the TV set may also be controlled by the hand-held remote device 
5514. If an optional TV tuner 5616 is provided in the base unit 5512, the hand-held remote 
device 5514 may also display different programming than displayed on the standard TV set. The 
channel will be selected on the hand-held remote device 5514 via the tuner of the base unit 5512. 

When the hand-held remote device 5514 displays the program of the TV set 5510 
attached to the base control unit 5512, the function keys on the hand-held remote device 5514 
may be used to control the TV set. The signal of the respective function key selected on the 
hand-held remote device 5514 by the user is decoded and sent to the base unit 5512. There, the 
microprocessor 5626 chooses the appropriate IR code for the selected function on the attached 
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TV set 55 10 and writes the IR code 55 10, into the IR adapter 5652. By use of an attached IR 
transmitter 5654 placed in front of the TV set 5510, the IR code is sent to the conventional video 
IR receiver. 

The remote control functions in this embodiment comprise the conventional television 
functionality, for example, channel up, channel down, direct channel number input, volume up, 
volume down, stand-by. Functions like mute, brightness, contrast, etc. act only locally on the 
display device 5724 of the hand-held remote device 5514. The same functionality is provided if 
the built-in tuner 5616 of the base unit 5512 is used. In this case, no IR transmission is needed. 

A second important function of the Personal TV system 5500 of the present invention is 
the use of a remote control (RC) device for control of the customer's equipment, including 
conventional consumer appliances. The hand-held remote device 5514 may be adapted to control 
all conventional TV sets, VCRs and other devices by sending the appropriate well-known IR 
commands. A large conventional IR code base is provided in the memory of the base unit 55 12. 
Special codes may also be downloaded to the base unit 5512. Optionally, the hand-held remote 
device 5514 may be provided with the feature of learning unknown IR codes (teach-in). 

During setup, the user must identify his/her equipment and must register the type of 
equipment in the hand-held remote device 5514 during an installation process. Comfortable 
menus guide and direct the user to perform tests to control the devices thereby assisting the user 
in setting up the Personal TV system 5500 correctly. 

In the RC mode, a menu is displayed on the LCD 5724. Next to the softkeys displayed on 
LCD 5724 on the left and right sides of the LCD display 5724, textual or iconized menu items 
present the main functions of the selected device. The mode screen may start with the menu for 
the first TV set 5510 or with the menu for the device last recently used (depending on setup). 
One of the keys pops up a selection menu of all registered equipment in the customer's household 
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to allow for switching to the RC menu of another device. This RC mode controls the equipment 
via IR commands. Therefore, the hand-held remote device 55 14 must be in the same room and 
aimed at the device being controlled. In another embodiment, the hand-held remote device 5514 
includes an RF transceiver for communicating commands to appliances being controlled by the 
hand-held remote device 5514 in the RC mode. In this manner, the hand-held remote device 5514 
does not have to be in the same room and aimed at the device being controlled. The RC mode is 
not to be confused with the RF remote control mode, which operates via RF all over the house, 
but only on the attached TV set 5510. 

Another important feature of the Personal TV system 5500 of the present invention is 
called Personal Navigator, which enables use of a hand-held electronic program guide (EPG). 
This feature is described in detail above. The EPG is presented on the LCD 5724 and operates 
with the several softkeys displayed on the left and right sides of the display 5724. Using a 
special selection procedure called a "ping-pong" menu (described above), the user is guided 
through the selection process. The "ping-pong" menu starts with principal choices presented on 
the one side of the display 5724. Subsequent choices are displayed on the opposite side of the 
display 5724. Those menu items may include, but are not limited to, 



program selection by time, 

program selection by genre, 

program selection by station, 

program selection by keyword, 

program selection by input of a code number, 

program selection by recalling preprogrammed preferences and 

entering of a programming process to define personal preferences. 
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The user selects one of the options displayed using the hand-held remote device 5514. 
Then, on the opposite side of the display 5724, a submenu opens up presenting additional choices 
for that topic. So, the next choice after "time" could simply be "now" to show what is currently 
on the air. More complex selections continue by always presenting the next submenu on the 
opposite side of the display 5724 until the selection process is completed. At the end of the 
selection process, the EPG shows a selection list of programs, which fit the qualifiers the user has 
chosen. This selection list includes program information like title, station, time, short program 
description etc. This selection list may be scrolled using cursor keys. The highlighted (or 
inverted) items in the selection list may be marked by the user for later automatic reminder and 
additional, more in-depth information on how the show may be obtained. By pressing the "OK" 
key on the hand-held remote device 5514, the TV set 5510 connected to the base unit 5512 will 
be switched to the selected program. Other functions in EPG mode include VCR programming of 
an item from the selection list or selection of radio transmissions (optionally) and similar 
functions. Having chosen an interesting program from the selection list, one can easily program a 
VCR to record that selected program. Simply by pressing one key on the hand-held remote 
device 5514, the appropriate programming of the VCR is performed by sending the appropriate 
IR codes. Before final programming of the VCR, the hand-held remote device 5514 informs the 
user about the length of the show being recorded (for use of an appropriate length videotape) and 
asks the user for confirmation. If more than one type of VCR is registered in the Personal TV 
system 5500, the user is also asked which VCR he/she wants to program. 

Optionally, the Personal TV system 5500 of the present invention may be equipped with 
other functional components. One such optional component is a decoder for decrypting 
encrypted TV transmissions in the base unit 5512. The decoder 5615 of one embodiment is 
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shown in Figure 56. The decoder 5615 may be used for programs to be watched at the attached 
TV set 5510. In this case, the Personal TV system 5500 acts like a conventional decoder. Again, 
the decoded show could also be presented on the hand-held remote device 55 14. If the optional 
tuner 5616 is installed in the base unit 5512, a decrypted transmission from that tuner 5616 may 
be watched on the hand-held remote device 5514 independently from the main TV set 5510. To 
grant permission to the base unit 5512 to decode a ciphered show, the hand-held remote device 
5514 is equipped with a smart-card reader 5734. A card inserted into the reader 5734 may be 
used to identify and authenticate the user thereby enabling the base unit 5512 to decode the 
program. The smart card may enable viewing of pay-per-view programming or enable a service 
for a certain period of time. The smart card can also work as a prepaid card allowing a consumer 
to watch transmissions on a case-by-case basis. 

If the Personal TV system 5500 is equipped with a modem 5618 or other network 
interface, additional features are possible. One could implement a small browser for accessing 
the Internet (www) and web page contents. The browser is installed as software in the hand-held 
remote device 5514 and/or software in the base unit 5512. Web pages obtained via the network 
interface 5618 are formatted for display on the hand-held remote device 5514. Internet access 
may enable the use of the Personal TV system 5500 for use in e-commerce (home-shopping, 
home-banking etc.). The security of the e-commerce transactions can be ensured using passwords 
or the smart-card reader 5734 to validate user identity and authorization. Separately or combined 
with Internet access, email functionality can also be realized in the Personal TV system 5500. 
Again, email software installed in the hand-held remote device 5514 and/or in the base unit 5512 
enables user access to network resident email messages via the Personal TV system 5500. 
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The hand-held remote device 5514 may also be used to implement a personal database for 
storing the data in the base unit 5512. A menu system controlled on the hand-held remote device 
5514 serves as input and output of that personal database. 

The Personal TV system 5500 can also act as a cordless telephone. To achieve that 
function, conventional cellular or satellite circuitry for wireless telephone communications is 
installed in the base unit 5512 and/or the hand-held remote device 5514. 

To enable the Personal TV system 5500 to work as an EPG, the respective program guide 
data must be downloaded into the memory of the base unit 5512. Possible updates of the system 
software may also be downloaded into the memory of the base unit 5512 and/or the memory of 
the hand-held remote device 5514. Also, IR commands for controlling various types of 
appliances may be downloaded into the memory of the base unit 5512 and/or the memory of the 
hand-held remote device 5514. These data transfers and others need a data channel for 
transferring large amounts of data to the Personal TV system 5500. 

One possible data channel is the transport of data packets traveling in the VBI (vertical 
blanking interval) of the standard TV signal. The data may be coded similarly to conventional 
videotext pages and invisible to normal videotext users. This technology is widespread and often 
used for transport of data in the context of TV systems. However, in some cases, it may be 
difficult to find VBI capacity for the data needed by the Personal TV system 5500. Nearly all of 
the available VBI bandwidth may be used for other special services. Further, assuming a data 
volume for the EPG of approximately 1 Mbyte, it will take about 20 minutes to deliver the data 
using a single VBI line. In addition, the use of VBI transport as a data channel makes the 
integrated tuner 56 16 in the base unit 55 12 a must. While a TV program may come from the TV 
set 55 10 via the SCART interface 5614, the EPG data and other data may not. It may be 
impractical to have the TV set 5510 on and running on a special station for example at night to 
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get a data update via the VBL Additionally, hardware for the decoding of the videotext 
information and a FIFO interface to the microprocessor are necessary. As the VBI transfer is a 
broadcast transmission, one also needs a unique identification number 5624 in the Personal TV 
system 5500. This addressability allows direct transfer of requested IR codes and other personal 
messages addressed to a particular unit. 

An alternative way to implement the data channel needed is the use of a modem 5618 
connected to the telephone system and thereafter connected to a computer network, such as the 
Internet. The easiest way to install an infrastructure to broadcast the EPG data is the 
establishment of an Internet based server. A cooperation with an Internet service provider (ISP) 
will allow the Personal TV base unit 5512 to dial-in and to access the server for data download. 

Assuming again a 1 Mbyte set of data and a fast modem 5618, the data transfer should 
take about four minutes for a complete update. As only the new data must be downloaded, the 
average connection time per day will be less than one minute, thereby giving reasonable cost 
figures for building the Personal TV system 5500. 

The following section describes the structure of one embodiment of the base unit 5512 of 
the Personal TV system 5500. Figure 56 illustrates a block diagram of this embodiment of the 
base unit 5512. 

Referring to Figure 56, the upper left corner shows the SCART interface 5614 to the TV 
set 5510. From there the video and audio signal of the current transmission is transferred to the 
input multiplexer 5630 of the signal processing path. If the base unit 5512 possesses no own 
tuner 5616 and/or Pay TV decoder 5615, the multiplexer 5613 will not be needed. The following 
ADC 5632 converts the analog signals into digital data streams, which are fed into the data 
multiplexer and overlay unit 5634. This unit selects the data to be sent to the hand-held remote 
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device 5514. In TV mode, the multiplexer and overlay unit 5634 multiplexes video and audio 
packets. In the other modes, the multiplexer and overlay unit 5634, with assistance from the 
image memory and mode controller 5643, transfers data packets from the image memory 5644 
for display in the hand-held remote device 5514. Optionally, it is possible to overlay the video 
signal with portions of the image memory 5644. This feature enables graphic overlay over the 
displayed video. In addition to these data packets, messages are multiplexed into the data stream. 
For example, messages are used for sending IR codes, signaling sounds and smart-card 
commands. 

The final data stream flows into a spread spectrum coder 5636 and transmitter 5638 
working in the 2.4 GHz range. The data stream is transmitted to the hand-held remote device 
5514 as an RF signal. Typically, about 10-mW output power should be sufficient. Without a 
data compression mechanism and assuming that a net data rate of about 7.8 Mbits/s is needed, 
the result of this structure is a bandwidth of about 4 MHz times the spreading factor of the spread 
spectrum transmitter. This is a fairly large bandwidth for a simple video signal. Probably, 
bandwidth requirements may easily be reduced to half without visible degradation of the video 
image on the LCD display 5724. The larger bandwidth is only needed in TV mode. Possibly, 
one could abandon the spread spectrum transmission in TV mode, because transmission errors 
are less critical. 

Because of the presence of image memory 5722 in the hand-held remote device 5514, a 
much lower data rate is sufficient for transfer of the graphic data. In view of the upcoming 
Bluetooth standard for transmission, this structure will deliver more than enough bandwidth for 
these functions. 

The microprocessor 5626 builds up the data for display in the non-TV modes in the 
image memory 5644, which is mapped directly into the processor's 5626 memory space. The 
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image memory controller 5642 manages the dual port access of the image memory 5644. The 
image memory controller 5642 also works as a general mode controller, which the 
microprocessor 5626 accesses to enable different modes of the system. 

The receiving path of the base unit 5512 can be much simpler, because of the lower data 
rates required. If no (optional) microphone for cordless telephone function is supplied, low 
transmission rates will be enough if serving only the function keys, the smart-card reader and 
eventually the IR receiver (for teach-in) of the hand-held remote device 5514 device. The input 
data is received, descrambled and fed into a FIFO 5640 from where the microprocessor can read 
the input data. 

The components described so far (except the SCART interface 5614) may be integrated 
into one application specific integrated circuit (ASIC) 5610 to a large extent. Additional 
functions to be integrated into that ASIC are the IR adapter 5652 and the videotext decoder 5640. 
The IR adapter 5652 is needed in the RF remote control mode. The microprocessor 5626 
decodes the function keys pressed in the hand-held remote device 5514 and provides the 
necessary IR command code to the IR adapter 5652. That adapter 5652 generates the modulated 
IR pulses, which are transmitted by the IR light emitting diode (LED) 5654 in a separate 
housing. The TV set 5510 receives the IR signals and responds with the appropriate function. 

The videotext decoder 5640 is an optional part. It serves as a data receiver when using 
the VBI data transport. Videotext decoder 5640 is controlled by the microprocessor 5626 and 
commanded to scan the input VBI data stream for a particular identifier. Upon encountering the 
identifier, the videotext decoder 5640 delivers the received data in a small FIFO where it is 
fetched by the processor 5626. 

Outside of the ASIC 5610 in this embodiment, the microprocessor 5626 resides with its 
DRAM 5620 and Flash memory 5622. The processor 5626 can be a simple, conventional 16-bit 
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type processor (e.g. xl86) that is fast enough to build up the menu screens and to respond to 
queries to its stored data. Eventually, when enabling WWW access, the browser and/or the 
graphical user interface may require a conventional 32-bit processor. A conventional 32-bit 
processor also would ease the handling of the large memory. Otherwise (with only 1 Mbyte 
address range), memory banking would have to be implemented. Without the Internet function, 
DRAM 5620 of about 1 Mbyte and Flash memory 5622 of about 2 Mbyte would be sufficient. 
The size of the memory largely depends on the functionality supported by a particular system. 

An identifying unique number for each base unit 5512 can be read out from an ID device 
5624. Thus, unique addressability is enabled, for example, in videotext broadcast transmissions 
or in internet access. 

The standard base unit 5512 is equipped with a power supply 5660 delivering the 
necessary voltages and the charging circuits for the batteries 5742 of the hand-held remote device 
5514. 

Many of the other parts of the Personal TV system 5500 are optional. Either the tuner 
5616 or the modem 5618 should be installed, depending upon the data transport mechanism 
chosen. The tuner 5616 is a standard TV tuner/EF amplifier that delivers video and audio signals 
of the selected channel at the output. The modem 5618 type has to reflect the telephone 
connection of the user (analog, digital). The speed in analog mode is not critical. The cost per 
update will increase if a slow modem (14k - 28.8k bits/s) is used. When using WWW access, a 
56K modem would be desirable so as not to degrade the system performance and response. 

The decipher box 5615 decrypts ciphered video signals when this mode is enabled by the 
insertion of a smart card in reader 5734 and validation of the card via the processor 5626. The 
structure of the decipher block 5615 can vary depending upon the particular security system 
chosen. 
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In another embodiment of the present invention, the hand-held remote device 5514 is 
enabled to operate with a plurality of base units 5512 and the base unit 5512 is enabled to control 
a plurality of hand-held remote device 5514. In this embodiment, the hand-held remote device 
5514 includes a user interface displayed on the display 5724 that enables a user to log into the 
hand-held remote device 55 14 and/or a base unit 5512 with a user identifier. In this manner, a 
hand-held remote device 5514 owned by a corresponding user could be used with someone else's 
base unit 5512 or vice versa. Further, because each hand-held remote device 5514 is coupled to a 
network for the receipt and transmission of external information, one hand-held remote device 
5514 can be configured to communicate with a second hand-held remote device 5514 via the 
network. The user login identifiers and/or the base unit identifiers 5624 can be used to direct 
network messages in a point-to-point communication. Using this functionality provided by this 
embodiment of the present invention, two or more users of a hand-held remote device 55 14 can 
interact in real-time from a remote location. Thus, interactive games, chat sessions, or remote 
collaboration between networked users is possible with the present invention. Because the hand- 
held remote device 5514 is network connected, a set of user information can be obtained from a 
user and stored locally in the hand-held remote device 5514, in the base unit 5512, on a smart 
card or other portable media, or stored in a repository on a network server coupled to the 
network. This user information, associated with a user login identifier or a base unit identifier 
5624, can represent a user profile for automatically configuring a user session on a hand-held 
remote device 5514 to a particular user's previously defined preferences. The user profile can 
thereby travel with the user as the user moves to different locations accessible to the network 
with the hand-held remote device 5514. 

Thus, a control device and system for remotely viewing video programming and for 
monitoring and controlling electronic devices is disclosed. Although the present invention has 
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been described with reference to specific exemplary embodiments, it will be evident that various 
modifications and changes may be made to these embodiments without departing from the 
broader spirit and scope of the invention as set forth in the claims. Accordingly, the specification 
and drawings are to be regarded in an illustrative rather than a restrictive sense. 
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CLAIMS 

What is claimed is: 

1 . A control device for monitoring and controlling an electronic device, comprising: 

a base unit including a microcontroller and a data interface coupled to the microcontroller for 
sending and/or receiving external information, the base unit further including a video interface 
for receiving video programming signals; and 

a hand-held remote device in communication with the base unit via a data link, the hand-held 
remote device further including a display component for displaying at least a portion of the 
external information received from the data interface, said display component also for rendering 
video content in said video programming signals received from the video interface. 

2. The control device as claimed in Claim 1 wherein the data interface further includes a modem 
for sending and/or receiving said external information via a network. 

3. The control device as claimed in Claim 1 wherein the data interface further includes a set-top 
box interface for sending and/or receiving external information via a set-top box. 

4. The control device as claimed in Claim 1 wherein the data interface further includes a 
computer interface for sending and/or receiving external information via a computer. 

5. The control device as claimed in Claim 1 wherein the external information includes 
electronic program guide information. 

6. The control device as claimed in Claim 1 wherein the external information includes 
electronic commerce information. 
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7. The control device as claimed in Claim 1 wherein the external information includes 
information obtained from the Internet. 

8. The control device as claimed in Claim 1 wherein the external information includes 
electronic mail information. 

9. The control device as claimed in Claim 1 wherein the external information includes control 
code information. 

10. The control device as claimed in Claim 1 wherein the external information includes software 
or firmware upgrades for the base unit or the hand-held remote device. 

11. The control device as claimed in Claim 1 further including a non- volatile memory device 
coupled to the microcontroller for storing a unique identifier. 

12. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes a smart card interface for receiving additional external information. 

13. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes a smart card interface for validating user identity. 

14. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes a smart card interface for enabling execution of applications. 
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15. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes a smart card interface for receiving a smart card having resident thereon a software 
application. 

16. The control device as claimed in Claim 1 wherein the functionality of the base unit and the 
functionality of the hand-held remote device are integrated together into the same unit. 

17. The control device as claimed in Claim 1 wherein the functionality of the base unit is 
integrated into a television set. 

18. The control device as claimed in Claim 1 wherein the functionality of the base unit is 
integrated into a set- top box. 

19. The control device as claimed in Claim 1 wherein the functionality of the base unit is 
integrated into a computer. 

20. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes functionality for use as a wireless telephone. 

21. The control device as claimed in Claim 1 wherein the base unit further includes a video tuner 
for extracting a channel for viewing on said display component of the hand-held remote 
device from among a plurality of input video programming signals. 

22. The control device as claimed in Claim 1 further including an overlay unit for combining said 
video content with microcontroller-generated images. 
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23. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for selecting a program by program time from a selection list. 

24. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for selecting a program by program type from a selection list. 

25. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for selecting a program by broadcast station from a selection list. 

26. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for selecting a program by program keyword from a selection list. 

27. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for selecting and recalling personal preferences from a selection list. 

28. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for selecting and recalling personal preferences using a code input. 

29. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for activating a function for displaying detailed information about a 
particular program. 

30. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for activating a marking function for marking at least one program for 
application of further specified functions. 
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31. The control device as claimed in Claim 1 wherein the display component includes an 
information display for displaying a history of user selections previously made. 

32. The control device as claimed in Claim 1 wherein hand-held remote device further includes a 
selection component for automatically rearranging menu selections of the selection list based 
on a history of user selections previously made. 

33. The control device as claimed in Claim 1 wherein the data link includes an infrared link. 

34. The control device as claimed in Claim 1 wherein the data link includes an RF link. 

35. The control device as claimed in Claim 1 wherein the data link includes a direct electrical 
link. 

36. The control device as claimed in Claim 1 wherein hand-held remote device further includes 
control information for remotely controlling an electronic appliance. 

37. The control device as claimed in Claim 1 wherein hand-held remote device further includes: 

a display component for displaying a dual partition selection list, the dual partition selection 
list having a first selection list and a second selection list, at least a portion of the first selection 
list and at least a portion of the second selection list being at least partly concurrently displayable 
on the display component; and 

a selection component for selecting elements from the dual partition selection list, the 
selection component having a first selection component for selecting elements from the first 
selection list, a selection made from the first selection list using the first selection component 
causing a display of corresponding items in the second selection list while the first selection list 
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is at least partly concurrently displayed, a selection made from the second selection list using the 
second selection component causing a display of corresponding items in the first selection list 
while the second selection list is at least partly concurrently displayed. 

38. A hand-held remote device comprising: 

a video interface for receiving encrypted video programming signals; 
a decoder for decrypting said encrypted video programming signals; and 
a display component for rendering video content corresponding to said decrypted video 
programming signals received from the video interface. 

39. The control device as claimed in Claim 38 wherein the display component renders the video 
content on an attached television set. 

40. The control device as claimed in Claim 1 wherein base unit further includes a charging unit 
for charging the hand-held remote device. 

41. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes an LCD display screen, a speaker, and an earphone jack. 

42. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes a control unit for learning unknown control codes. 

43. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes a personal database. 
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44. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes an embedded browser. 

45. The control device as claimed in Claim 1 wherein the base unit further includes a personal 
database. 

46. The control device as claimed in Claim 1 wherein the base unit further includes an embedded 
browser. 

47. The control device as claimed in Claim 46 wherein the embedded browser processes at least a 
portion of the external information. 

48. The control device as claimed in Claim 1 wherein the data interface further includes a VBI 
decoder for receiving said external information via a VBI encoded signal. 

49. The control device as claimed in Claim 1 wherein the hand-held remote device further 
includes an interface to a different user operating a second hand-held remote device. 

50. The control device as claimed in Claim 1 further including storage for a user profile. 
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ABSTRACT 

A control device and system for remotely viewing video programming and for monitoring 
and controlling electronic devices is disclosed. In one embodiment, a control device for 
monitoring and controlling an electronic device, includes: 1) a base unit having a microcontroller 
and a data interface coupled to the microcontroller for sending and/or receiving external 
information, the base unit further including a video interface for receiving video programming 
signals; and 2) a hand-held remote device in communication with the base unit via a data link, 
the hand-held remote device further including a display component for displaying at least a 
portion of the external information received from the data interface, the display component also 
for rendering video content in the video programming signals received from the video interface. 
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DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 

(CONTINUATION-IN-PART) 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below, next to my name. 

I believe I am the original, first, and sole inventor (if only one name is listed below) or an original, 
first, and joint inventor (if plural names are listed below) of the subject matter which is claimed and 
for which a patent is sought on the invention entitled 

A HAND-HELD VIDEO VIEWER AND REMOTE CONTROL DEVICE 

the specification of which 



X 



is attached hereto, 
was filed on 



United States Application Number 

or PCT International Application Number, 
and was amended on 



as 



(if applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose all information known to me to be material to patentability as 
defined in Title 37, Code of Federal Regulations, Section 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, Section 1 1 9(a)-(d), of 
any foreign application(s) for patent or inventor's certificate listed below and have also identified 
below any foreign application for patent or inventor's certificate having a filing date before that of 
the application on which priority is claimed: 



Prior Foreign Application(s) 



Priority 
Claimed 



(Number) 



(Country) 



(Day/Month/Year Filed) 



Yes No 



(Number) 



(Country) 



(Day/Month/Year Filed) 



Yes No 



(Number) 



(Country) 



(Day/Month/Year Filed) 



Yes No 



I hereby claim the benefit under title 35, United States Code, Section 1 1 9(e) of any United States 
provisional application(s) listed below: 



Application Number 



Filing Date 



Application Number 



Filing Date 
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I hereby claim the benefit under Title 35, United States Code. Section 120 of any United 
States application(s) listed below and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the manner 
provided by the first paragraph of Title 35, United States Code, Section 112, i acknowledge 
the duty to disclose all information known to me to be material to patentability as defined 
in Title 37, Code of Federal Regulations, Section 1.56 which became available between the 
filing date of the prior application and the national or PCT international filing date of this 
application: 

09/078.604 5/13/98 Pending 

Application Number Filing Date Status patented, 

pending, abandoned 



Application Number Filing Date Status -- patented, 

pending, abandoned 



I hereby appoint the persons listed on Appendix A hereto (which is incorporated by reference 
and a part of this document) as my respective patent attorneys and patent agents, with full 
power of substitution and revocation, to prosecute this application and to transact all business in 
the Patent and Trademark Office connected herewith. 



Send correspondence to James H. Salter , BLAKELY, SOKOLOFF, 

(Name of Attorney or Agent) 

TAYLOR & ZAFMAN LLP, 12400 Wilshire Boulevard 7th Floor, Los Angeles, California 90025 

and direct telephone calls to James H. Salter , (408) 720-8300. 

(Name of Attorney or Agent) 
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I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 
of the United States Code and that such willful false statements may jeopardize the 
validity of the application or any patent issued thereon. 



Full Name of Sole/First Inventor Clemens Crov 



Inventor's Signature Date 

Residence Frankfurt, Germany Citizenship Austria 

(City, Country) (Country) 

Post Office Address Staufenstrasse 39 

60323 Frankfurt am Main, Germany 



Full Name of Second/Joint Inventor Rainer F.R. Bermbach 



Inventor's Signature Date 

Residence Wolfenbuttel, Germany Citizenship Germany 

(City, Country) (Country) 

Post Office Address BillrothstraBe 7 

D-38302 Wolfenbuttel. Germany 

Residence Citizenship 

(City, State) (Country) 
Post Office Address 
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APPENDIX A 

William E. Alford, Reg. No. 37,764; Farzad E. Amini, Reg. No. P42,261 ; Aloysius T. C. AuYeung, Reg. 
No. 35,432; William Thomas Babbitt, Reg. No. 39,591; Carol F. Barry, Reg. No. 41,600; Jordan 
Michael Becker, Reg. No. 39,602; Bradley J. Bereznak, Reg. No. 33,474; Michael A. Bernadicou, Reg. 
No. 35,934; Roger W. Blakely, Jr., Reg. No. 25,831; Gregory D. Caldwell, Reg. No. 39,926; Ronald C. 
Card, Reg. No. P44,587; Thomas M. Coester, Reg. No. 39,637; Stephen M. De Klerk, under 37 
C.F.R. § 10.9(b); Michael Anthony DeSanctis, Reg. No. 39,957; Daniel M. De Vos, Reg. No. 37,813; 
Robert Andrew Diehl, Reg. No. 40,992; Matthew C. Fagan, Reg. No. 37,542; Tarek N. Fahmi, Reg. 
No. 41,402; James Y. Go, Reg. No. 40,621; James A. Henry, Reg. No. 41,064; Willmore F. Holbrow 
III, Reg. No. P41,845; Sheryl Sue HoIIoway, Reg. No. 37,850; George W Hoover II, Reg. No. 32,992; 
Eric S. Hyman, Reg. No. 30,139; William W. Kidd, Reg. No. 31,772; Erica W. Kuo, Reg. No. 42,775; 
Michael J. Mallie, Reg. No. 36,591; Andre L. Marais, under 37 C.F.R. § 10.9(b); Paul A. Mendonsa, 
Reg. No. 42,879; Darren J. Milliken, Reg. 42,004; Lisa A. Norris, Reg. No. P44,976; Chun M. Ng, Reg. 
No. 36,878; Thien T. Nguyen, Reg. No. 43,835; Thinh V. Nguyen, Reg. No. 42,034; Dennis A. 
Nicholls, Reg. No. 42,036; Kimberley G. Nobles, Reg. No. 38,255; Daniel E. Ovanezian, Reg. No. 
41,236; Babak Redjaian, Reg. No. 42,096; William F. Ryann, Reg. 44,313; James H. Salter, Reg. No. 
35,668; William W. Schaal, Reg. No. 39,018; James C. Scheller, Reg. No. 31,195; Jeffrey Sam Smith, 
Reg. No. 39,377; Maria McCormack Sobrino, Reg. No. 31,639; Stanley W. Sokoloff, Reg. No. 25,128; 
Judith A. Szepesi, Reg. No. 39,393; Vincent P. Tassinari, Reg. No. 42,179; Edwin H. Taylor, Reg. No. 
25,129; John F. Travis, Reg. No. 43,203; George G. C. Tseng, Reg. No. 41,355; Joseph A. 
Twarowski, Reg. No. 42,191; Lester J. Vincent, Reg. No. 31,460; Glenn E. Von Tersch, Reg. No. 
41,364; John Patrick Ward, Reg. No. 40,216; Charles T. J. Weigell, Reg. No. 43,398; Kirk D. Williams, 
Reg. No. 42,229; James M. Wu, Reg. No. P45.241; Steven D. Yates, Reg. No. 42,242; Ben J. Yorks, 
Reg. No. 33,609; and Norman Zafman, Reg. No. 26,250; my patent attorneys, and Andrew C. Chen, 
Reg. No. 43,544; Justin M. Dillon, Reg. No. 42,486; Paramita Ghosh, Reg. No. 42,806; and Sang Hui 
Kim, Reg. No. 40,450; my patent agents, of BLAKELY, SOKOLOFF, TAYLOR & ZAFMAN LLP, with 
offices located at 12400 Wilshire Boulevard, 7th Floor, Los Angeles, California 90025, telephone 
(310) 207-3800, and James R. Thein, Reg. No. 31,710, my patent attorney. 
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APPENDIX B 

Title 37, Code of Federal Regulations, Section 1 .56 
Duty to Disclose Information Material to Patentability 

(a) A patent by its very nature is affected with a public interest. The public interest is best 
served, and the most effective patent examination occurs when, at the time an application is being 
examined, the Office is aware of and evaluates the teachings of all information material to patentability. 
Each individual associated with the filing and prosecution of a patent application has a duty of candor and 
good faith in dealing with the Office, which includes a duty to disclose to the Office all information known 
to that individual to be material to patentability as defined in this section. The duty to disclosure 
information exists with respect to each pending claim until the claim is cancelled or withdrawn from 
consideration, or the application becomes abandoned. Information material to the patentability of a claim 
that is cancelled or withdrawn from consideration need not be submitted if the information is not material 
to the patentability of any claim remaining under consideration in the application. There is no duty to 
submit information which is not material to the patentability of any existing claim. The duty to disclosure 
all information known to be material to patentability is deemed to be satisfied if all information known to 
be material to patentability of any claim issued in a patent was cited by the Office or submitted to the 
Office in the manner prescribed by §§1 .97(b)-(d) and 1 .98. However, no patent will be granted on an 
application in connection with which fraud on the Office was practiced or attempted or the duty of 
disclosure was violated through bad faith or intentional misconduct. The Office encourages applicants to 
carefully examine: 

(1 ) Prior art cited in search reports of a foreign patent office in a counterpart application, 

and 

(2) The closest information over which individuals associated with the filing or prosecution 
of a patent application believe any pending claim patentably defines, to make sure that any material 
information contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to 
information already of record or being made or record in the application, and 

(1) It establishes, by itself or in combination with other information, a prima facie case of 
unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a 
claim is unpatentable under the preponderance of evidence, burden-of-proof standard, giving each term 
in the claim its broadest reasonable construction consistent with the specification, and before any 
consideration is given to evidence which may be submitted in an attempt to establish a contrary 
conclusion of patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the 
meaning of this section are: 

(1) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of 
the application and who is associated with the inventor, with the assignee or with anyone to whom there 
is an obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by 
disclosing information to the attorney, agent, or inventor. 
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